Using ethnographic approaches to document, evaluate, and facilitate virtual community-engaged implementation research.

BACKGROUND: Community Advisory Boards (CABs) have been frequently used to engage diverse partners to inform research projects. Yet, evaluating the quality of engagement has not been routine. We describe a multi-method ethnographic approach documenting and assessing partner engagement in two "virtual" CABs, for which we conducted all meetings remotely. METHODS: Two research projects for increasing equitable COVID-19 testing, vaccination, and clinical trial participation for underserved communities involved remote CAB meetings. Thirty-three partners representing 17 community groups participated in 15 sessions across the two CABs facilitated by a social change organization. We developed ethnographic documentation forms to assess multiple aspects of CAB member engagement (e.g., time spent speaking, modality used, types of interactions). Documenters were trained to observe CAB sub-groups via virtual sessions. Debriefing with the documentation team after CAB meetings supported quality assurance and process refinement. CAB members completed a brief validated survey after each meeting to assess the quality and frequency of engagement. Content and rapid thematic analysis were used to analyze documentation data. Quantitative data were summarized as frequencies and means. Qualitative and quantitative findings were triangulated. RESULTS: A total of 4,540 interactions were identified across 15 meetings. The most frequent interaction was providing information (44%), followed by responding (37-38%). The quality and frequency of stakeholder engagement were rated favorably (average 4.7 of 5). Most CAB members (96%) reported good/excellent engagement. Specific comments included appreciation for the diversity of perspectives represented by the CAB members and suggestions for improved live interpretation. Debriefing sessions led to several methodological refinements for the documentation process and forms. CONCLUSION: We highlight key strategies for documenting and assessing community engagement. Our methods allowed for rich ethnographic data collection that refined our work with community partners. We recommend ongoing trainings, including debriefing sessions and routinely reviewed assessment of data to strengthen meaningful community engagement.

Engaging Underserved Communities in COVID-19 Health Equity Implementation Research: An Analysis of Community Engagement Resource Needs and Costs.

Background: Meaningful community engagement is instrumental to effective implementation and sustainment of equitable public health interventions. Significant resources are necessary to ensure that community engagement takes place in culturally sensitive, trusted ways that optimize positive public health outcomes. However, the types and costs of resources best suited to enable meaningful community engagement in implementation research are not well-documented. This study's objectives are (1) to describe a pragmatic method for systematically tracking and documenting resources utilized for community engagement activities, (2) report resources across phases of implementation research, and (3) provide recommendations for planning and budgeting for community engagement in health equity implementation research. Methods: Community engagement partners completed a tracking log of their person-hours for community engagement activities across three phases of community engagement (startup, early, maintenance) in two implementation research projects to promote equity in COVID-19 testing and vaccination for underserved communities. Both projects completed a six-session Theory of Change (i.e., a facilitated group discussion about current and desired conditions that culminated with a set of priorities for strategic change making) over 4 months with respective Community Advisory Boards (CAB) that included community organizers, promotores, federally qualified health center providers and administrators, and public health researchers. The reported person-hours that facilitated community member engagement were documented and summarized within and across project phases. Results: For both projects, the startup phase required the highest number of person-hours (M = 60), followed by the maintenance (M = 53) and early phase (M = 47). Within the startup phase, a total of 5 community engagement activities occurred with identifying and inviting CAB members incurring the greatest number of person-hours (M = 19). Within the early phase, a total of 11 community engagement activities occurred with coordinating and leading live interpretation (Spanish) during CAB sessions incurring the greatest number of person-hours (M = 10). The maintenance phase included 11 community engagement activities with time dedicated to written translation of CAB materials into Spanish incurring the greatest number of person-hours (M = 10). Conclusions: Study findings indicate that the most significant investment of resources is required in the startup period. Needed resources decreased, albeit with a greater diversity of activities, in later phases of community engagement with Spanish language translation requiring most in the later stage of the study. This study contributes to the community engagement and implementation science literature by providing a pragmatic tracking and measurement approach and recommendations for planning for and assessing costs to facilitate meaningful community engagement in public health implementation research.

Co-creating a Theory of Change to advance COVID-19 testing and vaccine uptake in underserved communities.

OBJECTIVES: To describe the use of a Theory of Change to meaningfully engage community members from or support underserved communities in two National Institutes of Health-funded implementation science projects aimed at promoting equitable access to COVID-19 testing and vaccination for underserved communities. STUDY SETTING: Both projects focused on Latino, Black, and immigrant and refugee communities in South/Central San Diego and/or individuals accessing care at a federally qualified health center near the US/Mexico border during December 2020-April 2021. STUDY DESIGN: By using a participatory action research design, Community Advisory Boards (CABs) were established for each project with 11 and 22 members. CAB members included community organizers, promotores de salud (community health workers), clinic providers and administrators, and public health researchers. The CABs were guided through a seven-session Theory of Change process, focused on identifying necessary conditions that must exist to eliminate COVID-19 disparities along with specified actions to create those conditions and a blueprint for assessing the impact of those actions. DATA COLLECTION: Each session lasted 2 h hosted virtually and was augmented by interactive web-based activities. There was a live interpreter who facilitated the participation of Spanish-speaking CAB members. A Theory of Change for each project was completed in approximately 4 months. PRINCIPAL FINDINGS: Nine necessary conditions were identified related to (1) accessible and available services; (2) culturally and linguistically competent programming; (3) investment in trusted community and faith leaders; (4) social safety nets to provide ancillary services. Corresponding actions to create these conditions and measures to indicate success in creating these conditions were operationalized by the CAB. CONCLUSIONS: While resource-intensive, a CAB-led Theory of Change process yielded a rich opportunity to engage diverse groups that typically are not invited to inform these processes.